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ABSTRACT 

The ability to explain scientific phenomena is a key feature of scientific literacy, and engaging students’ prior 
knowledge, especially their alternate conceptions, is an effective strategy for enhancing scientific literacy and 
developing expertise. The gap in knowledge about the alternate conceptions that novices have about many of Earth ’s 
complex phenomena (National Research Council, 2012), however, makes this type of engagement in geoscience 
courses challenging. This study helps to fill this gap by identifying and describing how novices to geoscience explain 
a complex scientific phenomenon, hurricane formation. Using a pragmatism methodology’, 326 students in 
introductory’-level geoscience courses at two public universities in the United States of America, in Georgia (n=168) 
and Nebraska (n=158), were surveyed. The questionnaire was designed to target and collect novices’ explanations 
of a single complex Earth phenomenon - hurricane formation. Constant comparative analyses of textual content and 
diagrams revealed a variety of alternate conceptions. The data suggess that novices seldom invoke scientific first 
principles, which students matriculating through the education system are expected to learn before college, in their 
explanations. Two theoretical models synthesize the alternate conceptions and illustrate pathways of conceptual 
change along which students might move from more novice-like to more expert-like ways of scientific thinking. Our 
findings provide a basis for the development of instructional activities that aid students in developing more expert¬ 
like conceptions of hurricane formation and other complex Earth phenomena. 

Keywords: Geoscience Education Research; Meteorology Education; Scientific Literacy; Misconceptions; Novice- 
To-Expert; Conceptual Change 


any people in the United States of America (USA) are directly or indirectly impacted by natural 
hazards, such as hurricanes (Dash & Gladwin, 2007; Dow & Cutter, 2000; Lazo, et al., 2010; Morss 
& Hayden, 2010; Simms, et al., 2013; Zhang et al., 2007). Few studies, however, document how 
laypeople explain these phenomena. The ability to explain scientific phenomena is a key feature of scientific literacy 
(Organization for Economic Co-Operation and Development [OECD], 2006). 



A strategy for advancing scientific literacy through classroom instruction involves engaging students’ prior 
knowledge, especially their alternate conceptions, in the learning process (Bransford et al., 1999). However, a barrier 
to implementing this strategy in geoscience courses is the gap in knowledge about the alternate conceptions that 
students have about many of Earth’s complex phenomena and processes (National Research Council, 2012). A 
broader and deeper understanding of students’ alternate conceptions could be used to facilitate their learning and 
development towards more expert-like ways of scientific thinking and reasoning. 


This is an exploratory study that uses a pragmatism methodology (Creswell, 2003) to address the aforementioned gap 
in knowledge. More specifically, this study focuses on student explanations of the scientific phenomenon of hurricane 
formation. Consistent with the pragmatism methodology, this study is done for the express purpose of continued 
research that builds on its findings (e.g., Chang & Linn, 2013; Opfer, et al., 2012; Parham, et al., 2010), such as 
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developing and testing assessment items dealing with hurricane formation that can be used in introductory-level 
college geoscience courses. With this in mind, the present study addresses two questions: 

i. How do novices to geoscience explain a complex scientific phenomenon, hurricane formation, prior to 
formal instruction on the subject? 

ii. How do the explanations of novices to geoscience contrast with one another and with an expert-defined 
explanation used in introductory-level college geoscience courses? 

In this study, we define novices to geoscience as persons who are just starting to learn about geoscience. To answer 
our research questions, a short, paper-based, open-ended questionnaire was administered to over 300 students enrolled 
in introductory-level college geoscience courses at two large Ph.D. granting, research extensive universities in the 
United States of America (USA), in Georgia (n=168) and Nebraska (n=158). Their responses were subjected to textual 
content analyses and diagrammatic analysis, and they were compared and contrasted with an expert-defined 
explanation pitched at the mastery level for an introductory-level college geoscience course. 

BACKGROUND AND THEORETICAL PERSPECTIVES 


Scientific Literacy 

Scientific literacy is a concept that is integral to developing an informed international citizenry that is equipped to 
address life situations in which science plays a key role (Bybee et al., 2009). Wysession (2012) discusses key literacy 
documents produced through geoscience community efforts that are relevant to those who teach about Earth 
phenomena in the USA. They include the Earth Science Literacy Principles (Wysession et al., 2009), the Essential 
Principles of Ocean Literacy (Carley et al., 2013), Essential Principles and Fundamental Concepts for Atmospheric 
Science Literacy (Johnson et al., 2009), and Essential Principles of Climate Science (US Global Change Research 
Program, 2009). These documents define an Earth-science literate person as one who understands the essential 
principles of the Earth system, knows how to assess scientifically credible information about the Earth system, 
communicates about the Earth system in a meaningful way, and is able to make informed and responsible decisions 
regarding actions that may affect the Earth system. 

For the Program for International Student Assessment (PISA), the OECD (2006) defines scientific literacy as being 
characterized by four interrelated features of an individual’s: (i) scientific knowledge and use of that knowledge to 
identify questions, to acquire new knowledge, to explain scientific phenomenon, and to draw evidence-based 
conclusions about science-related issues; (ii) understanding of the characteristic features of science as a form of human 
knowledge and enquiry; (iii) awareness of how science and technology shape our material, intellectual, and cultural 
environments; and (iv) willingness to engage in science-related issues, and with the ideas of science, as a constructive, 
concerned, and reflective citizen. In this exploratory study, we are particularly focused on students’ ability to explain 
scientific phenomena, using the example of how hurricanes form. 

Hurricanes, more broadly referred to as tropical cyclones, are Earth phenomena that can present themselves as natural 
hazards to citizens in the USA. For example, in 2005 alone, four major hurricanes made landfall in the USA, causing 
more than 2,000 deaths and $100 billion in damage (National Climatic Data Center & National Oceanic and 
Atmospheric Administration, 2013). Figure 1 illustrates hurricane tracks near to and in the USA between 1993 and 
2012. Hurricanes are phenomena that have relevance to not only citizens living in these areas but also to citizens 
across the nation because they can result in weighty costs (National Climatic Data Center & National Oceanic and 
Atmospheric Agency, 2013; Wuebbles et al, 2014). In the USA, taxes that citizens pay support disaster relief efforts 
such as the Heartland and Hurricane Ike Disaster Relief Act and the Natural Disaster Relief Act (Internal Revenue 
Service, 2009). As such, taxpayers’ and laypersons’ knowledge of how, where, and when natural disasters like 
hurricanes can facilitate informed decision making about how to prepare for (e.g., where to live or how to protect 
against the impacts of natural disasters) and how to respond to natural disasters after they occur (e.g., short-term 
support and long-term legislative acts). 
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Figure 1 . Map of hurricane tracks that affected the USA during the period 1993-2012 generated using the Historical Hurricane 
Tracks tool provided by the National Oceanic and Atmospheric Administration (https://coast.noaa.gov/hurricanes/). Curved lines 
overlaying the map represent hurricane tracks. The states in which participants were surveyed, Nebraska and Georgia, are outlined 
with thick white borders. The time frame shown on the map represents the time relevant to participants in the study. 


Hurricane formation was selected as the subject for studying novice explanations of a scientific phenomenon for three 
main reasons: (i) hurricanes are relevant to real-life situations that citizens in the USA experience directly and 
indirectly, (ii) the subject of hurricanes is relevant to and taught in introductory-level college geoscience courses, and 
(iii) hurricanes are an example of a complex Earth phenomenon that can be explained in terms of scientific first 
principles. Citing Aristotle, Gasser-Wingate (2016) defines first principles as propositions that are “necessary and 
explanatorily primitive truths from which all our scientific understanding is derived” (p. 2). For this study, we 
similarly define scientific first principles as fundamental or basic scientific concepts that represent abstract scientific 
knowledge, such as chemical and physical processes, that can be applied to explain more complex phenomena. 

Alternate Conceptions and Cognitive Models 

Alternate conceptions are discussed in the literature as existing along a spectrum from novice-like ideas to expert-like 
ideas (Bereiter & Scardamalia, 1986; Lindblom-Ylanne & Lonka, 2001; Wieman & Perkins, 2005; Wieman 2007) or 
along a spectrum from non-scientific to scientific ideas (Izquierdo-Aymerich & Aduriz-Bravo, 2003; Libarkin et al., 
2005; Mortimer, 1995). The idea of alternate conceptions is not new and others refer to these types of conceptions as 
misconceptions (Capps et al., 2013; Helm, 1980), alternate frameworks (Dal, 2007; Driver, 1981), preconceptions 
(Clement 1993; Novak, 1977), naive ideas (Clement, 1993; Kinchin etal., 2000; Reiner et al., 2000), and folk theories 
(Lakoff, 1987). The terminology used in the literature to discuss the idea of alternate conceptions is used 
inconsistently and ambiguously. This is, in part, due to a lack of a common language with which to discuss these 
ideas. In the present study, an alternate conception is defined as an idea or thought held by a student at any point in 
time relative to the instructional period of interest, formed by direct or inferred experience, and is more/less 
scientifically accurate and complete (Arthurs, 2011). The constructivist theory of learning is widely accepted today 
and states that people’s prior knowledge and experiences, including their alternate conceptions, play a pivotal role in 
their learning process (Bransford et al., 1999) by helping or hindering the process of conceptual change (Bransford et 
al., 1999; Murphy, 2007; Vosniadou & Brewer, 1992) that leads toward greater expertise. 

For this study, we refer to student-held ideas influenced by prior experience and knowledge as alternate conceptions 
or cognitive models. Individuals hold certain cognitive models that explain how the world around them operates. 
These cognitive models are based on everyday life experiences and assumptions that people generally accept to be 
true, and they may be incongruent with the equivalent scientific theories held by contemporary experts. 


Copyright by author(s); CC-BY 


3 


The Clute Institute 








Journal of Astronomy & Earth Sciences Education - June 2016 


I plume 3, Number l 


Novices’ alternate conceptions often disagree with accepted scientific conceptions held by experts and play a central 
role in the learning process. As such, integrating them into instructional activities can help facilitate students’ learning 
and their development towards more expert-like thinking. This type of integration of alternate conceptions into 
instruction is well aligned with a constructivist approach to teaching and learning (Bransford et al., 1999; Shell et al., 
2010). In order to integrate students’ alternate conceptions into instruction (including formative and summative 
assessments), it is necessary to first understand what they already know about a particular topic prior to formal 
instruction. In keeping with the pragmatism methodology (Creswell, 2003), the findings of this study will be used for 
further research for the development and testing of items that can be used in formative and summative assessments 
for use in introductory-level college geoscience courses that teach about hurricanes and their formation. 

Evidence of Cognition and Syntax for Framing Cognitive Models 

Although integrating alternate conceptions into teaching is an accepted means to facilitate learning, identifying 
individuals’ alternate conceptions is a challenge because ascertaining what people think does not lend itself to 
traditional models of quantitative scientific inquiry. Methods that utilize language (Dixon, 1982; Lakoff, 1987; Rosch, 
1975, 1981) and concept sketches (Johnson & Reynolds, 2005; Reusser et al., 2012; Smith & Bermea, 2012) provide 
a means to do so. Lakoff (1987) and his predecessors discuss three ideas that frame this study. First, the domain of 
experience is where human cognition lies. Second, individual interactions with the physical world and with language 
itself construct an individual’s domain of experience. Third, examination of the domain of experience and linguistic 
evidence provides insight into human cognition. We elaborate on this third point to also include concept sketches as 
representations of individuals’ cognitive models (Ifenthaler, 2011; Novak, 1998). 

This study extends previous cognitive models research in the geosciences (Kastens et al., 2009; McNeal et al., 2008; 
Rappaport, 2009). Cognitive science researchers view conceptual and cognitive models as two different types of 
models. Specifically, according to Norman (1983), “conceptual models are devised as tools for the understanding or 
teaching of physical systems,” and “mental [i.e., cognitive] models are what people really have in their heads and what 
guides their use of things.” This study utilizes Norman’s definitions of mental or cognitive models. Furthermore, the 
method used by Norman to discuss cognitive models is adopted and modified as described in Arthurs (2011). It 
provides syntax for clearly framing the distinctions in cognitive models of the same concept held by experts, defined 
by the general scientific community, defined by teachers for the purposes of level-appropriate instruction, and held by 
novices. It also recognizes that the researcher is privy to only the parts of an individual’s cognitive models that they 
self-report in verbal, written, or drawn form. Such self-reported data possess known limitations (Stone et al., 2000). 
These limitations include, for example, an individual (i) might think one way and not be aware enough of it to express 
it or (ii) might be aware enough of his thinking to satisfactorily express it but does not do so for a variety of reasons, 
including wanting to provide the response they believe is expected or correct (Norman, 1983). Furthermore, 
conceptualizations are not necessarily stable over time (Libarkin et al., 2003) or coherent relative to other personally 
held ideas (DeLaughter et al., 1998; Mark et al., 1999). Despite the known limitations with self-reported data, such 
data are the mainstay for cognitive models researchers and are collected and analyzed in this study to determine how 
novices explain a complex Earth phenomenon, hurricane formation. 

METHODS 


Methodology 

This study received Institutional Review Board (IRB) approval to conduct human subjects research at the participating 
institutions. This exploratory study utilized a pragmatism methodology because it is concerned with applications and 
solutions to problems, uses data collection and analysis approaches that make sense in the research context, and is 
done with the intention of further research that is informed by the current research (Creswell, 2003). Within this study, 
elements of both traditional qualitative and quantitative research approaches are utilized. In particular, the 
questionnaire elicits open-ended responses, which are qualitative data useful for studying participants’ ideas about the 
world around them (Kvale & Brinkmann, 2009). The sample size (n=326) is larger than that obtained for traditional 
qualitative studies; however, our purpose was to explore the range of ideas and different representations (Gaskell, 
2000) to a level of detail that is enriched by the larger sample size. Our focus was on sample adequacy, not sample 
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size. According to Bowen (2008), sample adequacy relates to demonstrating saturation of categories by which depth 
and breadth of information is achieved. This is aligned with achieving what Glaser and Strauss (1967) called 
maximum variation, through constant comparative analysis (which we describe in the Data Analysis section). The 
large sample size also lends itself to limited statistical chi-square analyses of some of the quantified qualitative data. 
We utilized a short open-ended questionnaire because previous research (Arthurs, 2011) that compared the utility of 
using four different approaches for studying student cognitive models showed that open-ended questionnaires are of 
greatest utility with respect to the quality of responses, data richness for revealing students’ conceptions or cognitive 
models, and the larger number of participants needed to identify a broad range of ideas and saturate the emergent 
categories. A qualitative and mixed-methods researcher unaffiliated with the study provided a peer review of our 
methods and found them appropriate for the study. 

Locating the Study and the Researchers 

This study was conducted at two Ph.D. granting, research extensive universities in two geographically distinct states 
in the USA, Georgia and Nebraska. Georgia is located on the eastern coast of the USA and abuts the Atlantic Ocean, 
whereas Nebraska is located near the center of the country and is entirely landlocked. Georgia is much more prone to 
hurricane landfall than Nebraska. Compared to Nebraska, Georgia is also in much closer proximity to other states 
that are also directly impacted by hurricanes (Figure 1). Both universities had a total student population of -20,000 
during the period of data collection. The authors are researcher-participants (Feig, 2011) because they were the 
instructors for three of the five courses from which participants for this study were recruited. 

Participants 

Purposive sampling is often used in education research (Lopez et al. 1997; Seidler, 1974; Smith, 1983; Zelditch, 1962), 
and we used purposive sampling to study undergraduate novices’ explanations of hurricane formation. One of the 
authors taught at both institutions and administered the questionnaire while at each institution. Qualitative studies 
used to identify diverse views related to a specific topic typically include five to 25 participants (Kvale & Brinkmann, 
2009). This study, however, is unique because it includes 326 participants. They were surveyed in five introductory 
college-level geosciences courses: Environmental Geology A (n=168, which is 72% of total enrollment), 
Environmental Geology B (n=67, which is 87% of total enrollment), Weather and Climate (n=46, which is 57% of 
total enrollment), Physical Geology A (n=34, which is 60% of total enrollment), and Physical Geology B (n=l 1, which 
is 8% of total enrollment). These lower-division courses were selected because they historically enroll students who 
are novices to geoscience seeking to satisfy their general education core requirements for science and/or meet the 
requirements for geoscience majors at the participating institutions. 

Drawing correlations with specific demographic data is not part of the research questions for this study. For this 
reason, demographic data were not collected from all courses; however, such data were collected from the 
Environmental Geology A course and the Environmental Geology B course (Table 1). In these courses, the majority 
of study participants were freshmen and sophomores; were not science, technology, engineering, and mathematics 
(STEM) majors; and were in-state residents. Based on historical enrollment patterns for the other three courses, the 
demographics are similar to the first two courses insofar as the students are mainly freshmen and sophomores, in-state 
residents, and non-STEM majors. These five courses, therefore, were reasonable places to recruit participants for this 
study about novices’ alternate conceptions about hurricane formation. 

Data Collection 

Participants responded to a short, paper-based, open-ended questionnaire that simply asks: 

How do hurricanes form? (1) Explain, in your own words, how a hurricane forms. (2) Draw and label a 
diagram to help illustrate your answer. 

The first part of the questionnaire elicits a textual response and the second part elicits a diagrammatic response. The 
main question was designed with two additional parts in order obtain two different but complimentary ways of 
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communicating the participants’ ideas so that the researchers could more fully understand participants’ ideas about 
hurricane formation. All participant responses were written in English. 

Prior to using this open-ended questionnaire for the purposes of this study, the questionnaire was part of a pilot study 
in 2010. The pilot study was conducted in Georgia with 252 undergraduate students enrolled in an introductory-level 
college geoscience course to evaluate the validity of the questionnaire. In particular, the pilot study examined whether 
the questionnaire was interpreted in the intended manner and that the elicited responses would be rich enough and 
clear enough for the researchers to obtain an understanding of students’ alternate conceptions about how hurricanes 
form. The results of the pilot study indicated that the questionnaire was interpreted in the manner intended and yielded 
the type of data-rich responses that would be useful for studying how novices understand hurricane formation, thus 
providing evidence of the questionnaire’s validity. 


Table 1. Participant demographics. 


Demographic 

GA EnvGe o % 

(n=168) 

NE EnvGeo % 

(n=67) 

Male 

64 

66 

Female 

36 

34 

Freshman 

36 

39 

Sophomore 

44 

24 

Junior 

11 

15 

Senior 

9 

15 

Standing unknown 

41 

7 

Geoscience major 

0 

1 

STEM major 

22 

22 

Non-STEM major 

78 

75 

Major unknown 

0 

3 

Lived in state for some time 

100 

100 


Note:. GA=Georgia. NE=Nebraska. Demographic information for participants recruited from the two Environmental Geology courses (one in GA, 
USA, and one in NE, USA). 


In all five previously described courses from which participants were recruited, the questionnaire was administered in 
class between the fifth and seventh week of a 15-week semester. Students in all five courses did not receive any 
instruction about how hurricanes form before the questionnaire was administered. Only one of the courses, the 
Weather and Climate course, discussed atmospheric processes at all prior to the time that the questionnaire was 
administered but, again, they did not receive explicit instruction about how hurricanes form. 

For the present study, participants in Georgia were surveyed in 2011 and participants in Nebraska were surveyed in 
2012. In the two aforementioned Environmental Geology courses, the questionnaire was administered as an in-class 
activity worth two points towards class participation. In the Weather and Climate course and the two Physical Geology 
courses, the questionnaire was administered anonymously without course credit or other incentive. 

A potential sampling bias exists in the collected data because (i) only students present in class on the day that the 
questionnaire was administered could choose to participate and (ii) students self-volunteered to participate. Despite 
the potential sampling bias, the questions this study aims to answer require that the participants be novices to 
geoscience and this requirement is deemed met for all participants because of their enrollment in introductory-level 
college geoscience courses. Note, it is beyond the scope of the present study to conduct evaluations of each 
participant’s knowledge and skills in the geosciences domain, and enrollment in an introductory-level college 
geoscience course is used as a proxy for participants’ novice-like levels of mastery in the geosciences domain. 

To prepare the collected paper-based questionnaires for analysis, individual responses were made anonymous, 
assigned an arbitrary alpha-numeric ID, and transcribed verbatim in Excel by one of the co-authors. The sketches 
were digitized and saved electronically. In the transcribed responses, sketches were described with key words for 
referencing purposes (e.g., “sketch of collision” and “sketch of low pressure”), but printed scans of the participants’ 
original sketches were used for the diagrammatic analysis. 
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Data Analysis 

Constant Comparative Analyses 

After the raw data was transcribed and digitized, the textual content analyses (Sapsford, 1999) and diagrammatic 
analysis (Gobert, 2000; Sibley, 2005) were conducted using constant comparative analyses to discover categories and 
themes in the collected data about the participants’ conceptions of hurricane formation. The selected method of 
constant comparative analysis is an adaptation of the one developed by Strauss and Corbin (1990). 

First, one of the co-authors defined the unit of analysis and the levels of granularity to conduct the analyses that would 
effectively serve as the basis for coding and subsequent analysis to answer the research questions. Holsti (1969) 
stresses the importance of correctly defining the unit of analysis as an essential first-step decision to systematically 
analyzing qualitative data. The unit of analysis defined for this study are not “text chunks” (Simons, 1993) but 
“thought units” or “units of meaning” (Buber et al., 2004). Each thought unit represents one communicated idea, 
irrespective of whether it is expressed in a single word, sign (e.g., a plus sign), or punctuation mark (e.g., a question 
mark); a verb-object sequence; a complete sentence; or an extended narrative. 

The same co-author defined two levels of granularity to conduct the constant comparative analyses. The first is at the 
level of the whole response. In the whole-response constant comparative analysis, each response is analyzed to 
identify the single thought unit about the initiating or dominant process behind hurricane formation in each 
participant’s explanation. The second level of analysis identifies additional thought units about hurricanes and their 
formation that might appear in each participant’s explanation. The results of this parsed-response constant 
comparative analysis may yield zero to several thought units related to hurricanes in general beyond the one identified 
during the whole-response analysis. 

The same co-author carefully read all responses for the constant comparative analyses to develop two schemes of 
emergent categories and themes, one for the whole-response analysis and one for the parsed-response analysis. As 
prior research into novices’ and laymen’s conceptions of hurricanes has not been conducted at this deep level, no 
existing a priori categories were used. After the two schemes were developed the other co-author reviewed them for 
content, clarity, and organization; this review contributed to the scheme’s validity and trustworthiness. 

Development and Application of Coding Rubrics 

The two schemes described above were then translated into coding rubrics that were then iteratively revised by the 
two authors through their application to the participant responses, discussion of discovered ambiguities in the rubrics, 
and discussion of discrepant coding between both authors. The final version of the full whole-response coding rubric 
is shown in Table 2 and an abbreviated version in Table 3. The final version of the full parsed-response coding rubric 
is in Table 4. Tables 2 and 4 both list the categories that emerged during the initial stage of the constant comparative 
analyses. They also show how these categories are aggregated into broader major themes. 

In Table 2, the whole-response Themes A-G are listed in order from the least expert-like ideas to the most expert-like 
ideas. While Themes A-G have at least some semblance of scientific relevance to hurricane formation. Theme H does 
not and is therefore listed last in Tables 2 and 3. In Table 4, the parsed-response categories associated with each 
theme are listed from the most to the least expert-like ideas. The emergent themes into which the emergent categories 
are aggregated are expressed as questions; note that these are not questions in the questionnaire. These questions are 
themes that represent implicit questions about hurricanes and their formation that participants addressed in their open- 
ended responses. 

Using the whole-response coding rubric, each participant’s whole response can be assigned to one and only one 
category based on the initiating or dominant process discussed in the participant’s explanations of how hurricanes 
form. Each major theme is assigned at least one representative sketch and one representative statement from 
participants’ responses for content clarification about the theme. Responses are coded based on what initiates 
hurricane formation. If no initiating process is indicated, then the dominant hurricane-related process described in the 
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participant’s response is coded. Two coders (the authors) independently applied the whole-response rubric to all 326 
questionnaires with initial intercoder reliability (Kurasaki, 2000; Yeaton & Worton, 1993) of 93%. Differences in 
coding were resolved through discussion and led to 100% agreement in the final codes assigned to each response. 

Using the parsed-response coding rubric, a single whole response can be parsed into separate textual and 
diagrammatic units. In this way, unlike the coding conducted with the whole-response rubric, a single whole response 
can be assigned more than one code with this rubric. One co-author was the coder who applied the parsed-response 
rubric to all 326 questionnaires. An Excel spreadsheet was developed to record the codes. The coding reliability was 
checked and re-checked; the coder applied the parsed-response coding rubric to the collected data four times, with 
one-week to six-month intervals between each application. During each of these applications, only minor adjustments 
were made, if any, providing evidence of high reliability. This check-coding supported the relative consistency of the 
coder’s judgement over time (Krefting, 1991; Miles & Huberman, 1994). 

Comparison of Novice Explanations against Expert Explanation 

Although there remain yet-to-be answered scientific questions about specific details of hurricanes (e.g., Wuebbles et 
al., 2014), there does exist agreement in the scientific community about how hurricanes form. 


Table 2, part 1 of 2. Whole-response coding rubric with supporting examples of participant statements. 


Emergent Theme 


Emergent Category 

Alpha 

. 

Numeric 

Initiating or Dominant Process for Hurricane Formation 

Code 


Code 

Representative example of participant statement 



1 

Two atmospheric bodies collide. 



Low pressure system collides with a tropical storm. 


Atmospheric bodies 
colliding, meeting, or 
mixing. 

2 

Hot air and cold air collide. 

A 

Hot and cold winds meet. 

3 

Dry air and moist air collide. 


Veiy dry air collides with moist air. 



4 

High pressure and low pressure collide. 



High and low pressure systems mix. 

B 

Air/Wind and water 

5 

Air/ Wind and water meet. 

meeting. 

Warm air and cold water meet creating a rotating storm system. 


Water currents meeting 
AND/OR water moving 
in circles. 

6 

Hot and cold bodies of water mix. 

C 

Hot and cold water mixing rapidly in a circular motion. 

7 

Water currents meet and/or Water moves in circles. 


Hot and cold water currents meet and force water upward. 


Air, wind, or stonns 

8 

Forms from (strong) winds or moving air. 


Air starts to circulate. 

move; hurricanes are 




Forms from storms; are storms. 




Caused by storms or wind and rain or bad weather. 




Pressure/ Temperature changes. 




Forms when temperature or pressures changes. 




Pressure/ Temperature gradients exist. 




Forms due to gradients of temperature and/or pressure. 



12 

Pressure increases. 


Differences in pressure, 
temperature, and/or air 
flow exist. 

Forms when air pressure increases. 

P 

13 

There is movement from high pressure area to low pressure area. 


Air moves from area of high pressure to low pressure. 



Warm air rises and cold air descends. 




Hot air rises and cold air drops. 




A more detailed role of pressure and temperature. 



15 

Heated air rises and forms clouds, low pressure area forms, wind 
flows from high to low pressure, and heat from water sustains 
hurricane. 


Note. Themes and categories emerged from the whole-response constant comparative analysis. 
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For this study, Gardiner’s (2009) explanation and illustration of hurricane formation were used as the expert-defined 
standard against which we contrasted the novice responses. This explanation does not include finer-grained details 
known by experts on hurricane genesis, but it addresses the mastery level of understanding participating instructors 
agreed was appropriate for introductory-level college geoscience courses. Below, we describe Gardiner’s explanation 
of hurricane formation: 

A hurricane (or tropical cyclone) forms when a cluster of storms organizes in the atmosphere and intensifies 
to form a tropical depression (wind speed: 38 mi/h or 61 km/h), intensifies further to form a tropical storm 
(wind speed: 39-73 mi/h or 63-117 km/h), and then further intensifies to form a hurricane (wind speed: >74 
mi/h or >119 km/h). Warm ocean water (>80°F or >26.6°C) provides energy that sustains a hurricane. 
Ocean surface water evaporates, warm moisture-laden air rises into the atmosphere, and an area of low 
pressure forms. As the warm air rises, it cools, condenses, and forms clouds. Light prevailing winds outside 
the hurricane steer it and let it grow. Relatively cooler air outside the hurricane is drawn into its central low 
pressure area; the air is warmed and collects evaporated water; and it rises, cools, and condenses, thus 
continuing the process. A hurricane’s rotation is due to the Coriolis effect, which is caused by Earth’s 
rotation. A hurricane weakens and dissipates when it moves over cooler ocean water or land. 


Table 2, part 2 of 2. Whole-res 

ponse coding rubric with supporting examples of participant statements. 

Emergent Theme 


Emergent Category 




Initiating or Dominant Process for Hurricane Formation 



LOflc 

Representative example of participant statement 



16 

Forms when air spirals into a low pressure area. 



Winds converge around a low pressure system in the ocean. 

17 

Forms when air spirals into a low pressure area due to PGF (pressure 
gradient force) 

F 

A low pressure area forming; 
hurricanes form around low 
pressure area. 

Forms when a low pressure system develops and due to the PGF wind 
goes to the low. 


Low pressure area forms (over ocean water). 




A low pressure area dips into the tropics. 


Low pressure area forms over warn water and under rising air. 



19 

Warm air rises from just above warm ocean and low pressure area forms 
under rising air. 



20 

Warm air rises and forms winds/clouds/storm. 



Warm air rises and forms clouds, storms, or hurricane. 

21 

Warm moist ocean air forms clouds/storm. 

G 

Warm air, moist air, water 
evaporation, or uplift of water 

Warm moisture-filled air forms clouds, cyclone, storms, or hurricane. 


Warm ocean water evaporates and condenses to form clouds/storm. 


forms clouds/storms. 


Warm water vaporizes and ‘feeds ’’ the storm. 


Warm ocean water/vapor is sucked up and forms clouds. 



23 

Low pressure system sucks warm water vapor from ocean, forms clouds, 
begins to rotate, increases in strength, and decreases in pressure. 




Plate tectonics. 




Hurricane forms by certain movement of tectonic plates. 


Note. Themes and categories emerged from the whole-response constant comparative analysis. 
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Table 3. Abbreviated whole-response coding rubric and results. 


Alpha 

Code 

Theme: Hurricanes form due to ... 

GA % (n=168) 

NE % (n=158) 

Total % 
(n=326) 

A 

atmospheric bodies come into contact with one another. 

37 

34 

35 

B 

air/wind and water meeting. 

19 

9 

14 

C 

water currents meeting and/or water moving in circles. 

3 

3 

3 

D 

air, wind, or storm moving. 

20 

23 

22 

E 

differences in pressure, temperature, and/or air flow. 

5 

12 

9 

F 

a low pressure area forming, or hurricanes form around 
low pressure area. 

8 

8 

8 

G 

warm air, moist air, water evaporation, or uplift of water 
forming clouds/storms. 

6 

7 

6 

H 

tectonic plates moving. 

1 

4 

3 


Note. GA=Georgia. NE=Nebraska. 


Table 4. Parsed-response coding rubric and results. 


Emergent Theme 

Emergent Category 

GA % 
(n=168) 

NE % 
(n=158) 

Total % 
(n=326) 


1. Over warm/tropical ocean water 

21 

17 

19 

A. Where do hurricanes 
form? 

2. Over ocean/sea/off land/off coast 

39 

44 

41 

3. Over warm water 

7 

4 

5 

4. Over water 

15 

15 

15 


5. Over land 

5 

5 

5 


1. Atmosphere and ocean 

25 

16 

21 

B. What Earth system 

2. Ocean 

3 

3 

3 

components are involved in 

3. Atmosphere 

67 

77 

72 

hurricane formation? 

4. Land 

1 

1 

1 


5. Tectonic plates 

2 

5 

3 


1. Coriolis effect 

1 

3 

2 

C. What causes a hurricane 
to rotate? 

2. Moving air/wind 

4 

3 

3 

3. Bodies of air collide with each other 

16 

17 

16 

4. Moving ocean water 

2 

<1 

1 


5. Tectonic plates collide with each other 

0 

<1 

<1 


1. Vertical movement of water (as gas) 

9 

6 

8 

D. What is the direction of 

2. Vertical movement of air (as gas) 

12 

8 

10 

movement of air and water 

3. Lateral movement of air (as gas) 

73 

77 

75 

in a hurricane? 

4. Vertical movement, of water (as liquid) 

7 

3 

5 


5. Lateral movement of water (as liquid) 

8 

9 

8 


1. Obtains heat from warm ocean water 

8 

8 

8 

E. What causes a hurricane 

2. Obtains heat (unspecified source) 

3 

2 

2 

to intensify? 

3-4. Picks up water as liquid or gas 

5 

5 

5 


5. Moves over the ocean 

8 

14 

10 

F. What determines a 
hurricane’s path? 

1. Wind moves storm toward land 

2 

2 

2 

2. It follows path of ocean current, 
ocean currents push it to land 

3 

1 

2 


1. Evaporation of ocean water; 
latent heat released 

5 

9 

1 

G. How is ocean water 

2. Something picks up moisture, humidity, or water 

1 

7 

4 

affected during hurricane 

vapor 



formation? 

3. Large wave(s) of water / like tsunami 

5 

8 

6 


4. A whirlwind/cyclone/tomado of water 

7 

5 

6 


5. Something in atmosphere picks up water 

14 

8 

11 


Note. Themes and categories emerged from the parsed-response constant comparative analysis. 
GA=Georgia. NE=Nebraska 


Copyright by author(s); CC-BY 


10 


The Clute Institute 










































Journal of Astronomy & Earth Sciences Education - June 2016 


I plume 3, Number l 


RESULTS 


Variation in Novices’ Alternate Conceptions 

A wide variety of novices’ alternate conceptions about hurricane formation were identified. The final application of 
the whole-response rubric in coding the 326 questionnaires yielded 24 categories and eight themes of novice 
conceptions about the initiating or dominant process that drives hurricane formation (Table 2). In explaining this 
complex scientific phenomenon, how hurricanes form, the novices to geoscience who were surveyed communicated 
a variety of conceptions in terms of types (i.e., the emergent themes) and degrees of specificity and accuracy (i.e., the 
emergent categories). 

The three most frequently occurring themes listed in order from the most frequent to the least frequent are: Theme A 
(35%), Theme D (22%), and Theme B (14%). Theme A (35%) represents the alternate conception or cognitive model 
of hurricanes forming due to atmospheric bodies (e.g., clouds or fronts) coming into contact with one another. 
Furthermore, there are two main ways that the surveyed novices to geoscience conceptualize the interaction between 
these two atmospheric bodies, either gradually or rapidly. Gradual contact of these bodies is exemplified in the use 
of language in their explanations such as “mix, ” “meet, ” and “come together. ” These explanations are accompanied 
by representative sketches such as those shown in Figure 2. In contrast, the conception that atmospheric bodies come 
into rapid and even violent contact with one another is communicated in their explanations with the use of language 
such as “collide’’ and sketches that suggest that the two bodies crash into one another (Figure 2). Whether the contact 
is gradual or rapid, the expert explanation used as the basis for comparison does not describe hurricanes forming due 
to two atmospheric bodies colliding with one another. 

Theme D (22%) represents the alternate conception or cognitive model of hurricanes forming due to air, wind, or 
storms moving and its representative sketches are like those often seen on newspaper, televised, and online weather 
reports (Figure 2). These explanations do represent a level of accuracy about hurricane formation but only in the most 
general of terms; indeed, a hurricane is a storm with moving air/wind. These explanations do not, however, explain 
what causes a hurricane to actually form. 

Theme B (14%) represents the alternate conception or cognitive model of hurricanes forming due to “air” or “wind” 
meeting with “water” and is characterized by representative statements such as “Warm air and cold water meet 
creating a rotating storm system, ” “A tornado [strong wind] touches down on water, ” and “Strong winds and water 
unite in rapid motion. ” These kinds of statements are accompanied by representative sketches such as those in Figure 
2. These explanations convey the conception that what is responsible for hurricane formation is wind blowing down 
on large bodies of water. It is not wind blowing down onto water but wind blowing into an area of low pressure over 
a warm ocean surface that is key. 

The two least frequently occurring themes of conceptions for how hurricanes form are Theme C (3%) and Theme H 
(3%). Theme C represents the alternate conception or cognitive model of hurricanes forming due to water currents 
meeting one another and/or water moving in circles, and Theme H represents the alternate conception or cognitive 
model of hurricanes forming due moving tectonic plates. Based on only the participant responses provided, it is 
unclear exactly how these participants connected tectonic plates with hurricane formation. One possible explanation 
is that these participants think that moving tectonic plates cause the ocean water to move in an upward swirling way 
to form a hurricane, as reflected in Theme G. Follow-up interviews with the participants would help test this 
explanation and clarify students’ ideas for the researchers, but such follow-up interviews were beyond the scope of 
the present study. 

The remaining three themes are Theme E (9%), Theme F (8%), and Theme G (6%), and they are discussed here in the 
order from the most frequently to the least frequently occurring. Theme E reflects the general conception or cognitive 
model that hurricanes form due to differences in pressure, temperature, and/or air flow. The categories and associated 
representative participant statements for Theme E are listed from the vaguest to the least vague. A statement that 
illustrates the vaguest category is " [Hurricanes form] when temperature or pressure changes,” whereas a statement 
that illustrates the least vague category is “ [Hurricanes form when] heated air rises and forms clouds, low pressure 
area forms, wind flows from high to low pressure, and heat from water sustains hurricane. ” 

11 


Copyright by author(s); CC-BY 


The Clute Institute 





Journal of Astronomy & Earth Sciences Education - June 2016 


I plume 3, Number 1 


Theme F (8%) reflects the alternate conception or cognitive model that hurricanes form because a low pressure region 
forms or that hurricanes form around a low pressure region. It is comprised of four categories (Table 2). As with 
Theme E, these categories also lend themselves to being listed from the most to the least vague. The vaguest category 
in this theme is illustrated by a representative participant statement, " [Hurricanes form] when air spirals into a low 
pressure system in the ocean. ” At the same time, the least vague category is illustrated by another representative 
participant statement, “[Hurricanes form when] warm air rises from just above warm ocean and low pressure area 
forms under rising air. ” 

Theme G (6%) reflects the alternate conception or cognitive model that hurricanes form due to warm and/or moist air, 
water evaporation, or the uplift of liquid water which forms clouds/storms. The most expert-like conceptions held 
among the surveyed novices appeared as thought units that are classified under Theme G. In particular, numeric 
category codes 20-22 (Table 2) include mention of key factors involved in hurricane formation such as warm ocean 
water, evaporation, rising air, etc. Although most of the responses under Theme G tend toward being more expert¬ 
like, responses assigned code 23 reveal clear conceptions involving the rising up of liquid water into the atmosphere. 
The drawings associated with Theme G (Figure 2) aid in further communicating the range of conceptions. For 
example, they include water vapor rising up (Figure 2w and 2x), liquid water spiraling into a rotating column of water 
as it is sucked up (Figure 2y), ocean water being sucked up (Figure 2z), and large waves rising up (Figure 2aa). 

Figure 2. Summary of representative sketches associated with each of the whole-response themes. These sketches are 
reproductions or tracings of key diagrammatic components that appeared in participants’ drawings. These components were 
selected during the whole-response constant comparative analysis because they are directly connected to participants’ ideas about 
the initiating or dominant process behind hurricane formation. 
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Distribution of Novices’ Alternate Conceptions 

The results of the whole-response coding were quantified and plotted in order to illustrate the frequency with which 
different conceptions are observed (Figure 3). Herein, these are referred to as distribution profdes of alternate 
conceptions. Figure 3a illustrates the distribution of the themes of novices’ conceptions about hurricane formation in 
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the total sample population, whereas Figure 3b illustrates the distribution profiles in terms of the subpopulations from 
Georgia (n=168) and from Nebraska (n=158). Figure 3b shows that all themes of novice conceptions about hurricane 
formation are shared to some extent between the two subpopulations. Conceptions that were held to a similar extent 
include water currents meet (Theme C), hurricanes form around a low pressure area (Theme F), and warm moist air 
is uplifted (Theme G). The most frequent conception for both subpopulations is that two atmospheric bodies contact 
each other (Theme A), and this type of conception is documented elsewhere (Westgate, 1978). Figure 3b also shows 
there are notable variations in the extent to which the two subpopulations conceive of hurricane formation. For 
example, more than twice as many Georgian participants attributed hurricane formation to interactions between wind 
and water (i.e., Theme B) than did Nebraskan participants. Meanwhile, more than twice as many Nebraskan 
participants generally stated that hurricanes form due to differences in pressure, temperature, or airflow (i.e., Theme 
C) than did Georgian participants. 

The Georgian and Nebraskan participant populations are large enough that the overall distribution profiles of alternate 
conceptions for each can be statistically compared. The nominal (versus ratio or interval) scale associated with the 
quantified qualitative data and having only a single theme assigned to each participant (using the whole-response 
rubric) means that a chi-square test of independence is appropriate for determining whether the distribution profiles 
of alternate conceptions held by Georgian and Nebraskan participants are statistically different. The results of this 
analysis are )C(7, N=326) = 14.27, p<0.025. They suggest that there is a statistically significant difference between 
the two populations. 


Figure 3. Distribution of profiles of alternate conceptions that emerged during the whole-response constant comparative analysis. 
The purpose of the whole-response constant comparative analyses is to identify the initiating or dominant process behind hurricane 
formation. Figure 3a shows the distribution profile for the total population of study participants. Figure 3b shows the distribution 
profiles for participants in Georgia (GA) and Nebraska (NE). A=Atmospheric bodies come into contact with one another. 
B=Air/wind and water meet. C=Water currents meet and/or water moves in circles. D=Air, wind, or storms move. E=Differences 
in pressure, temperature, and/or air flow. F=A low pressure area forms or hurricanes form around a low pressure area. G=Warm 
air, moist air, water evaporation, or uplift of water forms clouds/storms. H=Plate tectonics. 
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It is, however, worth noting that students in the Weather and Climate course in Nebraska had not yet learned about 
hurricanes up to the time that the questionnaire was administered in their class. They did, nevertheless, already learn 
about some atmospheric concepts, such as pressure gradients and temperature gradients in particular, which could 
influence their responses. In fact, six references to these concepts were made in the collected responses and all six 
came from participants in this course. To test whether student responses from this course might skew the Nebraskan 
subset of data, a chi-square test of independence was used to analyze the data without the responses from only that 
course. The results of this analysis are % 2 (7, N=280) = 13.66, p<0.05. 
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The combined results of both these chi-square tests of independence support one another in suggesting that (i) there 
is a statistically significant difference between the observed Georgian and Nebraskan distribution profdes of alternate 
conceptions, and (ii) the difference is not due to responses collected from the Weather and Climate course. 

Furthermore, the collected data show that students in this course also held alternate conceptions that fit into Themes 
A, B, D, E, F, and G. Themes C and H were the least frequently occurring in the total population surveyed and it is 
therefore not alarming that these conceptions did not occur in this course. 

Despite the survey being administered in this course about a third of the way through the semester, the instruction that 
students received about weather and climate up to that point did not significantly alter the variety of conceptions about 
hurricane formation when compared to students in other courses. Thus, it is appropriate to retain these students in 
the total sample for the purposes of exploring novice-like conceptions. 

Contrasting Emergent Novice Conceptions with Pre-Defined Expert Conception 

The expert geoscientist explanation for hurricane formation used a standard against which to contrast novices’ 
explanations is described in the Methods section. The final application of the parsed-response rubric (Table 4) to code 
the 326 participants’ questionnaires yielded 37 emergent categories. Note, it is possible for a single whole response to 
either include or not include one or more thought units classifiable under these categories. As such, the frequency 
counts associated with each category do not add up to the total number of participants. These categories were 
aggregated into themes. Seven of these themes are reported here and represented as questions that relate to hurricane 
formation. These themes, expressed as questions, are not items on the questionnaire; instead, they represent implicit 
questions that participants addressed in their open-ended responses and, as such, they are emergent themes. These 
themes, their categories, and occurrence frequency are shown in Table 4. 

The first theme, Theme A, is: Where do hurricanes form? The majority of participants (80%) indicated that hurricanes 
form over water of some kind. Incorrectly, 5% specified that they form over land or with tectonic plates. Correctly, 
19% specified that they form over warm oceans. 

The second theme, Theme B, is: What Earth system components are involved in hurricane formation? The majority 
of participants (72%, n=232) indicated that hurricanes are strictly atmospheric phenomena, 3% indicated that they are 
strictly oceanic phenomena, and 3% indicated they are the product of tectonic plate movement. Only 21% of 
participants correctly indicated that hurricanes form due to interactions between the ocean and the atmosphere. 

The third theme, Theme C, is: What causes hurricane rotation? About 16% of participants indicated that the collision 
when two atmospheric bodies meet causes hurricanes to rotate, and 1% indicated that the movement of ocean water 
causes the hurricane to rotate. A small minority (2%) correctly stated the Coriolis effect is involved in the rotation. 

The fourth theme, Theme D, is: What is the direction of movement of air and/or water? Of the 326 respondents, 75% 
(n=244) included mention of lateral air movement in their text, concept sketch, or both. Only 10% included mention 
of vertical air movement. Vertical movement of air is also an integral part of hurricane formation, as warm moist air 
rises off the ocean surface; however, only a minority of respondents mentioned vertical air movement. Table 4 
captures one level of data analysis granularity classified under Theme D, but there is a finer-grained level of analysis 
and it is discussed here. Among participants, 8% indicated lateral movement of liquid water, 8% indicated vertical 
movement of water as vapor/gas, 5% indicated vertical movement of liquid water from the ocean into the atmosphere, 
and 15% drew concept sketches with spiraling columns of air/water rising off the ocean surface. An example of a 
representative participant statement that exemplifies this particular thought unit is: 

“A hurricane forms when very strong winds cross each other and form a wind cyclone over the ocean. This 
sucks water from the ocean and as more water is collected into the warm air the more powerful the hurricane 
becomes. ” 
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The fifth theme, Theme E, is: What causes a hurricane to intensify? Eighty-five participants (25%) addressed this 
theme. Of them, 27 participants (8%) accurately identified a hurricane’s location over warm water as the cause of 
hurricane intensification, with approximately the same percentages from Georgia and Nebraska. Other reasons 
provided for why hurricanes intensify included their movement over the ocean, their need for heat, and their picking 
up water/moisture. 

The sixth theme, Theme F, is: What determines the hurricane’s path? A smaller percentage of participants (4%, n=14) 
addressed this theme. Of them, seven participants (2%) correctly attributed wind as the mechanism that drives 
hurricanes toward land, while another seven identified ocean currents as the driving factor. 

The seventh theme, Theme G, is: How is ocean water affected during hurricane formation? Approximately 33% of 
participants addressed this theme. Six percent of the participants described the formation of a “whirlwind, ” 
“cyclone, ” or “tornado ” of water; 6% indicated that large waves of water or tsunami form; 11% stated that something 
picks up ocean water; 11% indicated that something picks up “moisture, ” “humidity, ” or “water vapor’’; and 1% 
indicated that ocean water evaporates. The most expert-like of the participants’ associated with this theme is that 
“ocean water evaporates. ” 


DISCUSSION 

Variation and Distribution of Alternate Conceptions 

All major themes described in the whole-response rubric are present in both the Georgian and Nebraskan 
subpopulations. Although these two subpopulations of novices to geoscience have alternate conceptions in common, 
the frequencies with which they appear are statistically significantly different, as shown in the chi-squared tests of 
independence previously described. Because these subpopulations are similar demographically in the ways needed 
for this study (i.e., novices to geoscience), the observed difference in their distribution profiles of alternate conceptions 
(Figure 3b) appears to be related to their geographic locations and other possible location-related variables. That is, 
the observed difference may be due to the participants’ experiences living in a state that is historically more directly 
affected by hurricane landfalls (i.e., Georgia) and its neighboring states versus living in a state that is far from any 
area in the USA where hurricanes make landfall in the USA (i.e., Nebraska). However, testing this explanation is 
beyond the scope of the present study and presents a possible avenue for future research. 

Although further research is needed to explain the observed difference in these two subpopulations’ distribution 
profiles of alternate conceptions, the work of others such as Lakoff (1987) and Atwater (2012) demonstrate that the 
place where one lives informs the development of their conceptions. The data presented in this article suggests that 
some conceptions about hurricane formation transcend location, whereas others may be influenced by each 
subpopulation’s prior knowledge and experiences living in the two locations sampled for this study. 

Theoretical Models to Characterize Cognitive Models 

Conceptual change (Vosniadou, 1994) is often discussed in terms of progressing along a spectrum from novice to 
expert ways of thinking (Chi et ai, 1981; Johnson et al., 1981; Larkin, 1985). Building on the notion that expertise 
develops in a linear progression from a novice state to an expert state and utilizing a constant comparative approach 
to analyze and interpret participants’ explanations of hurricane formation, two original theoretical models were 
generated to synthesize the empirically ascertained cognitive models or alternate conceptions. Each theoretical model 
coherently synthesizes, knits together, and visually represents the novice alternate conceptions or cognitive models 
identified in this study relative to one another and relative to the expert conception described in the Methods section. 
To do so, the first model plots the location of emergent themes identified using the whole-response rubric along a 
theoretical novice-to-expert spectrum, and the second model plots the location of emergent themes identified using 
the parsed-response rubric. 
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Model 1 


The first model, the whole-response model (Figure 4), is not comprised of a single linear novice-to-expert spectrum. 
Instead, it has two spectra that are connected to each other at their expert ends. One spectrum primarily plots 
conceptions that deal with physical movement of “observable” components in the Earth system. The second spectrum 
plots conceptions that deal with “unobservable” physical or chemical process. The closer a conceptual theme is plotted 
to the expert ends of the spectra, the more expert-like it is; and the closer it is plotted to the opposite end of each 
spectrum, the more novice-like it is. The conception of hurricane formation being due to moving air (Theme D) is 
plotted on both spectra because moving air is not necessarily observable but evidence of moving air is observable 
(e.g., trees swaying in the wind). 


Figure 4. Model 1, the whole-response model. The purpose of the whole-response constant comparative analyses is to identify the 
initiating or dominant process behind hurricane formation. Each downward-descending arrow in Model 1 represents a spectrum 
of novice-like to expert-like conceptions. The darker the color along the spectrum, the more expert-like the conception is. Both 
arrows move toward and converge at the expert conception. 
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This theoretical model has implications from the perspective of teaching novices to geoscience about hurricane 
formation. First, it highlights the fact that novices employ overly simplistic heuristics (Kahneman, 2011) to explain 
a complex scientific phenomenon, thus suggesting that instructional strategies to help novices develop more 
scientifically accurate explanations - whether it be to explain the formation of hurricanes or other complex phenomena 
- need to be developed, tested, and implemented in classroom teaching. Second, because the conception that moving 
air is responsible for hurricane formation is related to both spectra, a potentially useful starting point for teaching 
novices about hurricane formation is discussing with them what air is and what causes it to move. Because students 
have prior knowledge about moving air in their everyday life experiences (e.g., seeing trees swaying in the wind or 
seeing sand blowing around) this “observable” heuristic could be capitalized on in order to build novices’ 
understanding of the “unobservable” scientific first principles that underlie hurricane formation and move them along 
the second spectrum towards more expert-like thinking. 
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Model 2 

The second model, the parsed-response model (Figure 5), is also not characterized by a single novice-to-expert 
spectrum. Instead, it is comprised of seven axes that intersect at the center of five concentric circles, forming a novice- 
to-expert web. This novice-to-expert web is an innovation from this research. Each axis relates to one of the emergent 
themes and contributes to the level of detail described in an individual’s explanation of hurricane formation. Each 
concentric circle relates to the level of accuracy relevant to a specific theme and evident in the same individual’s 
explanation. The more themes that are addressed, the more detailed the explanation is; and the closer that the 
statements about each theme are plotted to the center of the orb web, the more accurate the explanation is. The more 
detailed and accurate an explanation is, the more expert-like it is. 

Figure 5. Model 2, the parsed-response model. The purpose of the parsed-response constant comparative analyses is to identify 
information that participants included in their responses beyond the initiating or dominant process behind hurricane formation. 
Model 2 is characterized by seven axes that intersect at the center of five concentric circles, forming a web. Each axis relates to 
one of the emergent themes and contributes to the level of detail described in an individual’s explanation of hurricane formation. 
Each concentric circle relates to the level of accuracy relevant to a specific theme and apparent in the same individual’s explanation. 
The more themes that are addressed, the more detailed the explanation is; and the closer the statements about each theme are plotted 
to the center of the web, the more expert-like that statement is. [] indicate ideas that were not seen in the sampled population’s 
responses. 
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Application of this model is illustrated using two complete explanations from the collected questionnaires (Figure 6). 
The corresponding novice-to-expert webs are illustrated in Figure 6. 
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Figure 6. Two examples of novice-to-expert. The first example shows that the student does not provide a very detailed description 
but that is provided are more expert-like in terms of accuracy. The second example shows that the student has twice as much detail 
as the first example, has the same level of accuracy for Theme A and Theme B, and has fairly novice-like ideas about Theme E 
and Theme G. 



Plotting individuals’ explanations on novice-to-expert webs can serve as a useful tool that can be used by teachers and 
researchers to visually characterize and quickly summarize where a student is in their developmental path towards 
greater expertise. The novice-to-expert web can be completed by a teacher or researcher at different time points 
relative to instruction as a way to illustrate conceptual change that might occur from one point in time to another. For 
demonstration purposes, Figure 7 represents the product of a thought experiment using the novice-to-expert web. It 
is a completed novice-to-expert web that plots fictitious but plausible pre- and post-instruction explanations from a 
hypothetical student. With it, one can quickly see that the hypothetical student became more expert-like in her 
explanation during the hypothetical instructional period. An inspection of the axes for Theme C and Theme F shows 
that there is no change after instruction. In the case of Theme C, the student failed to address this aspect of hurricane 
formation both before and after instruction, hence the absence of data markers on this axis. Novice-to-expert webs 
can be developed for and are transferable to other in-depth studies of alternate conceptions, conceptual change, and 
the development of expertise. They also have the potential to be used by practicing (geo)science teachers to provide 
students feedback regarding their conceptual development. 
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Explanations of Earth Phenomena and Scientific Literacy 

Skills that are characteristic of experts include, for example, the ability to call on and appropriately apply knowledge 
to new and different contexts outside the original context in which they were learned in order to explain and solve 
problems (Chi et al., 1981; Johnson etal., 1981; Larkin, 1985; Libarkin & Kurdziel, 2006). Geoscientists invoke such 
knowledge in the form of scientific first principles to describe and hypothesize about myriad Earth phenomena. First 
principles that can be invoked to explain how hurricanes form include, for example: (i) Heat is the transfer of energy, 
(ii) Changes in temperature contribute to changes in phase, (iii) Differences in temperature contribute to differences 
in buoyancy, and (iv) Differences in gradient control flow. 

Figure 7. Demonstration of novice-to-expert web as a tool for plotting conceptual change. This figure demonstrates how the 
novice-to-expert weh can he used to plot a student's ideas about hurricanes before and after instruction. The data plotted are 
fictitious and purely for demonstration purposes. The figure illustrates a hypothetical scenario of individual conceptual change 
where the hypothetical student holds more expert-like conceptions about hurricane formation after the hypothetical learning period. 



These are scientific first principles that are well matched with learning goals outlined in Project 2061’s Benchmarks 
for Science Literacy (American Association for the Advancement of Science, 1993); the benchmarks are grade- 
appropriate learning goals that educators can use to design core curriculum that will aid students in the USA to achieve 
science literacy goals outlined in Science for All Americans (Rutherford & Ahlgren, 1990). In particular, the first 
principle of interest listed above (i.e., heat is the transfer of energy) is well aligned with two learning goals that students 
are expected to achieve by the end of eighth grade: (i) “Energy’ can he transferred from one system to another (or 
from a system to its environment) in different ways: 1) thermally, when a warmer object is in contact with a cooler 
... ” and (ii) "... Thermal energy can also be transferred by means of currents in air, water, or other fluids. ” The 
second principle of interest listed above (i.e., changes in temperature contribute to changes in phase) corresponds well 
with a learning goal that students are expected to achieve by the end of eighth grade: “ Water evaporates from the 
surface of the earth, rises, and cools, condenses into rain or snow, and falls again to the surface. ” The third principle 
of interest listed above (i.e., differences in temperature contribute to differences in buoyancy) is in accord with a 
learning goal that students are expected to achieve by the end of fifth grade: “Heating and cooling can cause changes 
in the properties of materials, but not all materials respond the same way to being heated and cooled. ” The fourth 
principle of interest listed above (i.e., differences in gradient control direction of flow) is best matched with another 
learning goal that students are expected to achieve by the end of eighth grade: 

Transfer of thermal energy’ between the atmosphere and the land or oceans produces temperature gradients 
in the atmosphere and the oceans. Regions at different temperatures rise or sink or mix, resulting in winds 
and ocean currents. These winds and ocean currents, which are also affected by the earth’s rotation and the 
shape of the land, cany thermal energy from warm to cool areas. 
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Although the scientific first principles that we identified as useful for applying to explanations of hurricane formation 
are associated with learning goals that college students in the USA should achieve in middle- and high-school, very 
few of this study’s participants drew on them to explain how hurricanes form. Table 5 lists statements taken from 
participants’ responses that illustrate how each first principle can be invoked in order to explain how hurricanes form. 
Nevertheless, analysis of the collected data shows that novices to geoscience overwhelmingly do not invoke first 
principles to explain Earth processes. Possible reasons why these first principles might not be invoked by novices to 
geoscience include: (i) a lack of familiarity with them, (ii) a lack of proficiency in applying them, and (iii) a preference 
for the easy use of access heuristics over more effortful thinking (Kahneman, 2011). 

The fundamental scientific first principles discussed above directly relate to the idea of “abstract scientific 
knowledge” that appears in the PISA 2006 Science’s rubric for internationally assessing 15-year old students’ 
proficiency in explaining scientific phenomena (Bybee et al., 2009). PISA results for all students tested in all of the 
participating nations in the OECD show that only -10% of students demonstrated the highest levels of proficiency in 
explaining scientific phenomena (Bybee et al., 2009). This study’s finding that the vast majority of college students 
recruited for this study did not utilize scientific first principles is consistent with the PISA results that show students 
around the world generally have very low proficiency in explaining scientific phenomena. The PISA Science 2006 
science literacy score for 15-year old students in the USA is below the OECD average (Bybee et al., 2009), and this 
study’s findings support this low PISA score for the USA and shows that this deficiency is propagated to and retained 
at the college level. 


Table 5. Scientific first principles useful for explaining hurricane formation. 


First Principle 

Representative Example of Participant Application of First Principle 

1. Heat is the transfer of energy. 

Warm ocean water provides energy for the hurricane. 

Warm ocean water leads to evaporation of ocean water. 

2. Changes in temperature contribute to changes 

Warm ocean water evaporates, changes from liquid to gas. 

in phase change. 

Cool moist air condenses, changes from gas to liquid. 

3. Differences in temperature contribute to 

Warm air rises. 

differences in buoyancy. 

Cool air descends. 

4. Differences in gradient control direction of 
flow. 

Air flows from area of high pressure to low pressure. 


Note. The representative examples of participants’ application of the first principles are included in the actual student language used in their 
responses. 


SUMMARY 

Using a pragmatism methodology (Creswell, 2003), this exploratory research addressed the broad problem that the 
geoscience education community has of not understanding the alternate conceptions that students bring with them to 
the classroom setting (National Research Council, 2012), which may help or hinder their continued learning 
(Bransford, 1999). The purpose of this study was to more fully understand the conceptions about hurricane formation 
that novices bring to the classroom for the express intention of future research to develop and test items for formative 
and summative assessments (Rivet & Kastens, 2012). In this way, the identified alternate conceptions may also be 
integrated into classroom instruction in such a way as to move geoscience students from more novice-like to more 
expert-like ways of thinking about and explaining scientific phenomena; that is, to develop appropriate scaffolding 
(Chi et al., 1994; Reiser, 2004) that could also be informed by, for example, the theoretical models presented herein. 

The data collected here suggest a wide variation of alternate conceptions through careful, in-depth, and time- 
consuming analysis of qualitative data collected from 326 college students at two different state universities in the 
USA to discover how they explain a specific scientific phenomenon, how hurricanes form. All of the major themes 
of novice conceptions that emerged in the whole-response coding process are present among the novice explanations 
of hurricane formation collected in both subpopulations, in Georgia (n=168) and in Nebraska (n=158). Nevertheless, 
the subpopulations’ distribution profiles of alternate conceptions are statistically different. 

PISA Science 2006 used the ability to explain scientific phenomena as one of several features in their definition of 
scientific literacy. The present examination of novices’ explanations of how hurricanes form reveals that novices 
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generally do not invoke scientific first principles to explain this Earth phenomenon, even though students in the USA 
are expected to learn these first principles in their middle- and high-school science courses. 

Although studies of geoscience conceptions to date do identify misconceptions for a given concept, such as the water 
cycle (Ben-zvi-Asarf & Orion, 2005; Dickerson & Dawkins, 2004; Reinfried, 2006; Schwartz et al., 2011), this is the 
first study using a pragmatism methodology (Creswell, 2003) that systematically identifies and characterizes novice 
alternate conceptions by examining all data collected from a very large sample population (versus a small subset of a 
larger data set) for a targeted in-depth analysis of a single concept (hurricane formation). This type of study is 
unprecedented in misconceptions research, mainly because of the heavy time commitment needed to systematically 
analyze qualitative data of such size. Moreover, this study utilized the accepted practice of constant comparative 
analysis to generate two original empirically-supported theoretical models, which build on the (geo)science education 
community’s existing notion of conceptual change occurring along a single spectrum from novice-like ways of 
thinking to expert-like ways of thinking. In doing so, this study offers alternative ways to view the development of 
expertise. Taken together, the findings of this study provide insights that can help inform Earth science educators on 
how students’ alternate conceptions about hurricane formation could be used to scaffold learning. Furthermore, the 
novice-to-expert webs developed to characterize the extent to which an individual’s explanation of hurricane 
formation is like the expert conception, in terms of detail and accuracy, represents a model that has the potential for 
transferability to other misconceptions research. That is, modeling expertise in terms of detail and accuracy can be 
done with other data-rich qualitative studies about alternate conceptions. 

This study’s findings lead to the following recommendations: 

• Implement learner-centered strategies that allow students to resolve scientific inaccuracies in their prior 
knowledge, build on what they know in appropriately scaffolded ways, and practice applying scientific 
first principles in their explanations of scientific phenomena. 

• Tailor existing general interactive engagement strategies such as interactive demonstrations (Crouch et 
al., 2004), peer instruction (Crouch & Mazur, 2001), and classroom assessment techniques (Angelo & 
Cross, 1993) to the learning goals related to course concepts. 

• Use existing knowledge of novices’ alternate conceptions to develop (i) well-scaffolded course curricula 
and materials and (ii) valid and reliable instruments such as concept inventories. 

• Continue to deepen the geoscience education community’s knowledge of novices’ alternate conceptions 
through continued research in this area. 

• Pursue research that examines the potential regional and other location-influenced factors that can shape 
individuals’ alternate conceptions or cognitive models. 

The findings of this study form the basis of future work that can lead to (i) the development of research-based items 
for use in diagnostic, formative, and summative assessments; (ii) the development of a research-based multiple-choice 
survey that can be more widely distributed and more quickly analyzed; and (iii) further investigations to characterize 
potentially regionally-informed alternate conceptions. 
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